Kaiser 

MARQUARDT RED FLAG TWX (FINAL REPORT) 

FAILURE MALFUNCTION REPORT date of failure/malfunction 


SYMPTOMATIC REPORT 


05/23/97 


MANUFACTURER 


PAGE 1 OF 8fi 

REPORT NO. 

5285-001 REV. A 


SERIAL NUMBER OPERATING 
TIME/CYCLE 


UNKNOWN 


UNKNOWN 



WHAT OPERATION FAILURE DISCOVERED ? 


HOT-FIRE TEST 


WHAT WERE INDICATIONS & SUSPECTED CAUSE OF TROUBLE ? 


During Run No. 1038 a 1 second test, the test article was 
damaged by fire. Post test inspection revealed that the Hydrogen 
inlet fitting to the injector was consumed, and the hydrogen line 
was separated from the test article. 


ELAPSED TIME (MAN HOURS) 




TROUBLESHOOTING 


FUNCTIONAL TEST 


INSPECTION 


DOCUMENTATION 


Bob Humphrey 


7-14-97 


FAILURE ANALYSIS REPORT 


WHAT WAS THE CAUSE OF THE FAILURE 1 


The cause of the hot fire failure was LOX and GH 2 mixing and burning internally at the Hydrogen feedline prior to injector interface. The root cause for 
the fire has been traced to the GN 2 purge check valve on the LOX feed system. The internal components of the check valve were installed incorrectly 
allowing Oxygen flow into the Hydrogen feed system then into the injector. y 


CONT'D ON PAGE 


RELATED IRR, FMR. EO, ETC. 


EVALUATION 


EVALUATION & CORRECTIVE ACTION 

SEE PAGE 4 FOR EVALUATION & CORRFCTIVF ACTION 


Bob Humphrey 'fCi-n- 
Jeff Mays(0/J/T) DATE 


7-14-97 



RELATED CORRECTIVE ACTION 
DOCUMENTS (EOs. ETC.) 
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CORRECTIVE ACTION RESPONSIBILITY / 


RELIABILITY CONCURRENCE 










































WHAT WAS THE CAUS E OF FAILURE? (continued from 
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Figure 15 shows a collection of 'flake 1 particles observed below the injector/chamber assembly 
on the test cell floor. 



A Failure Investigation Cornrnittee (F .I.C.) was formed to follow-up on the investigation. The 
F.I.C. was chaired by Reliability, and members were brought in from Project, Manufacturing, 
Materials, and Data Engineering. A "Fish-Bone" diagram was assembled with input from all 
members of the F.I.C., SEE Figure 16. The different legs of the fish-bone were evaluated by both 
the responsible member of the F.I.C. and the chairman. 


The first leg reviewed was the Procedures. In this section there were three sub-categories. 
They were the “set-up" list, the "check-off" list, and the test procedure. All three items were 
covered in a Test Readiness Review (TRR), performed on May 19, 1997 SEE ATTACHMENT I. 
At that time, a system schematic of the piping and instrumentation was included, See Figure 17. 
The initial system schematic differs from the actual set-up which was physically verified after the 
failure, See Figure 18. 

The difference between the two schematics are as follows. The initial system schematic 
introduced during the TRR, indicated separate GN2 supply systems to the propellant lines. In the 
actual set-up schematic, the GN2 purge lines are common to both sides of the propellant system. 
The second difference is where the GN2 purge line enters the Hydrogen system. On the initial 
schematic, the purge is shown upstream of the Hydrogen check valve. In actuality, the purge 
enters the system downstream of the Hydrogen check valve. The "check-off" list and the actual 
Hot Fire Test procedure encompassed all necessary items to perform a successful test. 

The Material compatibility was examined, as was the cryogenic properties. The Oxygen 
Free copper #010200 employed in the design conforms to this application for both compatibility 
and cryogenically usage. The stainless steel plenum seal plates, and inlet fittings were also found 
to conform to this application, based on a literature search. The Material leg was eliminated as 
a contributing factor of the failure. 

On the Manufacturing leg, all the operations listed were verified to have been performed 
per requirements. However, during proof pressure test, the injector was pressurized internally to 
1,000 psid. The internal pressure was not the concern. The concern here was for the pressure 
which was downstream of the injector into the test fixture cavity. The pressure in the cavity 
caused the injector to flex and bend outward by 0.01 5in. The injector was straightened to within 
0.001 in. The injector was pressurized to 1,000 psid with a different configuration downstream. 
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However, the injector still flexed and bent 0.007in. Again the injector was straightened to within 
0.001 in. No damage was noted as a result of the distortions. No other anomalies were observed 
or discovered in the manufacturing or processing of the hardware. 

On the Design leg, the 'TEST SYSTEM' has been already addressed in this report. The 
wall thickness between the plenums and passages was reviewed with KM's stress expert. 
ATTACHMENT II of this report is the MEMO issued with the results. The conclusion of the report 
is that excessive stress was not a contributing factor in the failure of the injector. 

The injector was sectioned parallel to the injector face through the GH 2 plenum. Figures 
19, 20, and 21 show the sectioned halves of the injector. With these photographs, it is plain to 
see where the internal burning occurred. The plenum wall between the LOX and GH 2 has been 
burnt away. The sectioned halves were subjected to Scanning Electron Microscopy analysis. The 
first item examined was the injector half with the injector face. The black 'sooty' deposit observed 
on the face was analyzed and found to be copper/Stainless Steel mixture with some Carbon, and 
Teflon, See Figures 22 & 23. The Carbon residue is most likely the result of using "shop-air" in 
the ignitor. Any oil in the "shop-air" would have been combusted leaving behind the black, 'sooty' 
deposit. The Teflon found on the injector face appears to have come from the Teflon material 
lining the Hydrogen inlet flex line. The 'slag' observed on the injector face was found to be 
copper/stainless steel mixture. A high amount of Oxygen was observed in both traces. No Teflon 
was observed, See Figures 24 & 25. 

The interior edges were inspected at 12x and 18x magnification. The edges indicate 

molten melting of the material, rather than destruction from an explosion, See Figures 26 & 

27.The Thermocouple removed from the LOX side of the system was analyzed. No copper slag 

was present, See Figure 28. This is significant in showing that there was no "blcwback" up the 

LOX side of the system. Hence forward flow was constant throughout the test. The 'flake' particle 

observed on the bracket behind the injector matches elementally to the injector, See Figure 29. 

Looking at the lOx mag. photograph in Figure 30, the pattern of the four internal holes is still 
visible. 
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The data from the 'cold-flow' tests was compared to the hot-fire flow data. Several 
anomalies were observed. First anomaly observed is the slow rise in Chamber pressure during 
the hot-fire. The chamber pressure rose at a significantly faster rate during the cold-flow test. The 
second anomaly noted is a change in the flow of the Hydrogen at about 1 second into the test. 
It is after this point that there was internal burning in the injector taking place, See Figure 31. This 
anomaly was not observed in the GH2 cold-flow test run #1005, See Figure 32. No anomalies 
were observed in the LOX cold flow test, run #1004, Figure 33. 

The final anomaly observed was a recorded temperature of +200° F at T c 'LTT' after ignition 
spike on the LOX side of the system, (approximately 4" from the injector head), See Figure 34. 
No other temperature anomalies were observed. Detail test data analysis indicated that the failure 
could have occurred at the GN2 check valve on the LOX system, resulting in LOX flow into the 
Hydrogen system. (SEE ATTACHMENT III ANALYSIS REPORT by RON COOK). 

The GN2 check valve was removed from the test set-up and flow tested with GN2. The 
check valve flowed in both directions with inlet pressures of 2 to 2,000 psia. The internal 
components were removed, and examined. Physical verification of the GN2 purge check valve 
was performed. The internal components were verified to be installed incorrectly allowing for flow 
through the check valve in both directions See Figure 35. 
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E VALUATION & COR RECTIVE ACTION (continued from cover page.) I 
EVALUATION: 

As a result of the incorrect assembly of the GN 2 check valve used in the purge system, 
both sides of the propellant feed systems were subjected to LOX during the flow tests. The LOX 
flowed through the common purge line and into the Hydrogen side. The detonation in the chamber 
forced high temperature combustion gasses into the LOX and GH 2 feed systems, which started 
the burning process at the GH 2 line to injector interface. 

CORRECTIVE ACTION: 

Remove the remaining check valves in the system, and verify proper installation of internal 
components and functionality. 

The following is a list of recommendations which should be employed in the program as it 
progresses forward. 

HARDWARE: 

During build-up of the replacement injector, if a processing anomaly occurs, bring 
together the entire RBCC team to discuss and evaluate. 

At critical processing points, employ test coupons.. .i.e. brazing, etc. 

TEST SET-UP: 

* Use separate purge sources, if possible, or use double check valves in purge lines 
to prevent backflow. 

Do not cold-flow 1 propellants through the injector prior to the test. 

• Do not use 'shop air 1 for igniter. 

• Do not 'pulse 1 igniter during start-up. 

* Verify start-up ignition at lower pressure. 

Modify LOX and GH 2 plumbing to provide adequate purge and propellant flows. 
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• Move after-burner flare to within 3" of nozzle exit. 

• SEE ATTACHMENT IV MEMO REGARDING CALORIMETER TEST PLUMBING & 
OPERATIONS MODIFICATIONS 

DATA RECORDING: 

• Employ high speed video (400 to 450 fps) for future tests, use time coding feature. 

• Data recorders should be on at all times during test. 

• Provide a graphical display of critical test parameters. 
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THE LOX INLET. 





FIGURE 7- VIEW OF THE INTERIOR PORTION OF THE INJECTOR FROM 
THE HYDROGEN INLET. 
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FIGURE 11- BORESCOPE VIEW OF THE INTERIOR PORTION OF THE 
FLEX TUBE FROM THE END OPPOSITE THE BURNT SECTION. 








FIGURE 14 -"FLAKE" 
PARTICLE WHICH 
CAME TO REST BEHIND 
THE TEST ARTICLE 
ON A BRACKET. 
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PIPING AND INSTRUMENTATION DIAGRAM 


VENT 










FIGURE 20- INTERIOR PORTION OF THE INJECTOR AFTER 
SECTIONING. THIS IS THE VIEW LOOKING OUT TOWARDS THE 
INJECTOR FACE. 



FIGURE 21- INTERIOR PORTION OF THE INJECTOR AFTER SECTIONING 
THROUGH THE HYDROGEN PLENUM. IN THIS VIEW WE ARE LOOKING OUT 
THROUGH THE LOX INLET. 
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FIGURE 30- OVERALL VIEW OF THE "FLAKE" 
BACK MOUNTING BRACKET BEHIND THE ENGINE 
HIGHLIGHT THE 4 HOLES. 
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ATTACHMENT I 


TEST READINESS REVIEW 
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TESTING METHODOLOGY 
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SEQUENCE OF TESTING 
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TEST HARDWARE 
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SYSTEM SCHEMATIC 

PIPING AND I NSTRUME NTATION DIA GRAM 

VENT 
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TEST MATRIX 
COLD FLOW 
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TEST MATRIX 
HOT FIRE 
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SYSTEM SAFETY 
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TEST PLANNING 


TEST RUN DATA SHEET 
RBCC CALORIMETER 


RUN NO. 

RUN CONDITIONS: 


RUN DATE: 








EACH RUN IS PERFORMED 
VIA A RUN DATA SHEET 

PROMOTES VISIBILITY OF 
TEST CONDITIONS 


LOX Venturi Pressure psia LOX Tank Pressure: 

H 2 Venturi Pressure: psia H 2 Supply Pressure: 

Cooling Water Flow: lb/sec Water Tank Pressure: 

N 2 Purge Pressure (LOX): psia N 2 Purge Pressure (H 2 ) :_ 

H 2 /Air Ignitor Pressure Exhauster required? _yes 

Air psig 

psig 

Exhaust Torch Pressure 

Air psig 

psig 


ALLOWS EFFICIENT 
TRACKING OF TEST 
CONDITIONS 

PROVIDES QUICK 
REFERENCE FOR ALL 
PERSONNEL 


H2, LOX, Ignitor Timing (0 time is start of startup or shutdown) 
Startup: LOX on _ _ sec 

H2 on sec 

Ignitor on sec 

Ignitor off sec 


Shutdown: LOX oil 

H2 off “ 

Ignitor Operating Cycle ms on. 

Chamber Burn Duration: sec 

Operating Shut Down Limits- 

Water out temp. (16 places) > 

Water out press (16 places) < 

Chamber Press (after ignitor off) 

RUN DESCRIPTION 


sec 

sec 


ms Off (repeating cycle) 


psia 

<Ptl< 


Water flow 


psia 


lb/sec 


APPROVALS: 

Engineering 

Operations 

Project 

J. Mays 

B.R. Ellis 

R. Wieveg 


H:\MSWORD\Testsht.doc 


R Wievcg 


Kaiser Marquardt 


RBCC CALORIMETER TRR 
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ATTACHMENT II 


CALORIMETER INJECTOR PLATE - STRESS ANALYSIS 



KAISER MARQUARDT 
INTEROFFICE MEMORANDUM 


June 16, 1997 
file: in j 3 . 1 


TO : r . wieveg 

FROM: A. Runyon 

SUBJECT: RBCC - CALORIMETER INJECTOR PLATE - STRESS ANALYSIS 

RECOMMENDED PROOF PRESSURE & STRESS IN LIGAMENT BETWEEN 
INLET AND OUTLET PLENUMS 


COPIES: T. Chen, D. Lucci, S. Bartlett, R. Humphrey 

REFERENCES : 


1 . 


IOM to R. Wieveg from A. Runyon, RBCC- CALORIMETER IN- 
JECTOR PLATE - STRESS ANALAYSIS., Jan. 14, 1997 . 


INTRODUCTION : 


anal ysis of Reference 1 was reviewed and modified in 
of . certain problems with the copper Injector X42801A 
of the Calorimeter. The following tasks were addressed. The 
Injector is shown in Figure 1. ~ 


TASK l. Considering that the Injector yielded excessively at a 

proof pressure of 1,000 psi, what should be the revised 
Proof pressure ? 

TASK 2. Check the ligament between the inlet and outlet plenums. 

at magnitude stress causes failure across the section? 


DISCUSSION AND RESULTS : 
TASK 1 : 


3?® J5f es f model of the Injector from Ref. l was revised to con- 
servatively account for the .082 inch diamete holes which were 

" 6 S i^ 0 Q 7 " y - ig ?° red * o The reduced section properties are dated 
p, -i n F ?-f ure 2: the dimensions are shown in Figure 3. 

Plots of the old and revised bending moments of inertia are shown 

rnnnpr^ 7 n Fl9ure 5 sllow s the stress vs. strain curve of OFHC 
copper at 70 degrees F. 



page 2 

file: inj3.2 


The results for two pressures are shown below: 


FIGURE 5 

PRESSURE 

(PSI) 

STRESS 

(PSI) 

DEFLECTION 
( INCH) 

STRAIN 

(IN/IN) 

POINT A 

1,000 

9,875 

.0015 

PLASTIC 

POINT B 

700 

6,913 

.0011 

.00038 


It is seen from the stress versus strain curve that 1000 psi 
pressure will cause plastic straining up to .010 in/inch. 

This is excessive and should be reduced to 700 psi which will 
keep the stress in the elastic range of the copper material . 

The recommended proof pressure is 700 psig. 


TASK 2 : 


The finite element model shown in Figure 6 was used to assess 
the probability of a failure across the ligament caused by 
pressurization alone. The results for maximum stress in the 
ligament are as follows for three cases at 1000 psi pressure. 


CASE PRESSURIZED REGIONS 

A PLENUMS 1, 2 AND HOLES 

B PLENUM 1 ONLY 

C PLENUM 2 ONLY 


MAX STRESS 
(PSI) 

ULTIMATE STRENGTH 
AT 70 DEGREES F 
(PSI) 

7,880 

15,000 

6,845 

15,000 

5,420 

15,000 


Reviewing 

excessive 


the above numbers shows no reason to believe that 
stress is the cause of failure. 


The pressure to cause failure is estimated as 


(15,000 / 7 , 880 ) * (1000 ) = 1900 psig 
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ATTACHMENT III 


CALORIMETER FAILURE ANALYSIS BY RON COOK 
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ATTACHMENT IV 


CALORIMETER TEST PLUMBING AND OPERATIONS MODIFICATIONS 



KAISER 

MARQUARDT 

Interoffice Memo 


To: 

From: 

Subject: 

CC: 


Dis tribution Date: 6/19/97 

R. Wieveg Ref; 970619.doc 

Calorimeter Test Plumbing and Operation Modifications 


AS 3 M e f U ^u° f th ® fa ' lure investi 9 ation following the failure of the calorimeter injector 
in cell 8, The attached modifications to the plumbing/control system and operation 
procedures are recommended. 


A new gas/gas start up propellant flow system has been added. This system will 
allow less violent starts and permit development of a satisfactory start sequence 
without destroying the test hardware. Gas hydrogen and gas oxygen are admitted 
to the chamber during the 1 st phase of the ignition cycle. This gas mixture is easily 
ignited by the hydrogen air ignitor prior to introduction of the liquid oxygen and full 
gas hydrogen flow. Combustion chamber pressure during the gas/gas ignition 
phase will be controlled to about 75 to 150 psia. After verification by combustion 
chamber pressure of ignition, the liquid oxygen and high pressure hydrogen flow will 
be initiated, with constant monitoring of chamber pressure to insure continuous 
combustion. A rapid drop in chamber pressure (resulting from flame out) will initiate 
automatic shut down of propellant flows and initiate nitrogen purges in both the 
hydrogen and oxygen systems. 


The nitrogen purge for the hydrogen system will be moved to enter the hydroqen 
now line just upstream of the venturi and the venturi will be moved to a location 
downstream of the hydrogen flow shut off valve. Double check valves will be 
installed in both the hydrogen and oxygen purge lines at the point where they enter 
their respective propellant flow lines. Existing check valves in the purge and 

propellant lines will be removed and checked for leak free operation before being 
re-installed. y 


Additional instrumentation to provide propellant conditions at the entrance to the 
injector head will be installed. Automatic control of the gas/gas start up flow control 
valves and the hydrogen and oxygen purge shut off valves will be added to permit 
accurate timing and sequencing of these important functions. 

Distribution: 

S. Bartlett, T. Chen, f£9BQB3|, W. Kelly, A. Lucci, J. Mays, D. Ruttle 
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RBCC PLUMBING' MODIFICATIONS 
6 / 19/97 


1 . Install H 2 venturi downstream of cross (like 0 2 ), Move P and T 
instrumentation to match. 

2. Move all plumbing from shutoff valves to engine so line lengths 

are MINIMIZED. y 

3. Install P and T readouts at LOX and GH2 inlet connections on the 
injector. 

4. Move P chamber xducer lines from injector to chamber ports 

5. Move ignitor from injector port to chamber port. 

6. Add start up GOX and Gh2 plumbing and controls. 

7. Add computer control of start up GOX and GH2 valves and LOX 
and GH2 purge valves. 

8. System Leak, Function, and flow checks. 

9. Remove, Test, and replace 4 check valves. 

10. Scrounge and clean up 4 check valves, 2 shutoff valves and 3 
Regulators 


16 hrs 

16hrs 

16hrs 

6hrs 

4hrs 

20hrs 

lOhrs 

24hrs 

8hrs 

24hrs 


Contingency 10% 


14hrs 


TOTAL 


158hrs 



RBCC CALORIMETER TEST 
NEW OPERATING PROCEDURES 
6 / 19/97 
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RBCC CALORIMETER JEST 
NEW OPERATING PROCFm iPFg 
6 / 19/97 


GH? COLD FLOW- 


1. 

2 . 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10 . 
11. 
12 . 

13 . 

14. 


Turn on_cooling water (4.5 #/sec min.) 

Turn on exhaust duct water sprays. 

Turn on exhaust flare 

Set GN 2 purge pressure to 500 psia (static) 

Turn on GH 2 and LOX purge valves 

Open GH 2 run valve and adjust GH 2 regulator to five 
at venturi 

Close GH 2 run valve 

Run Automatic (computer controlled) GH 2 only flow with data 
for 1 0 seconds 


psia Pto 


recording 


Repeat from step 6 for all 4 GH 2 flow conditions (note GH 2 
loading pressure at each Pto (venturi) setting 
Shut off GH 2 and LOX purge vlaves 
Shut off flare 


regulator 


Shut off cooling water to test item 
Shut off exhaust duct cooling water 
Secure GH 2 system 
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RBCC CALORIMETFR JEST 
NEW OPERATING PROOFni ipfq 
6 / 19/97 


HOT FIRE TIMING’ 


Time - Seconds 

0.000 

0.150 

0.200 

0.250 

1.000 


1.150 

1.350 

1.600 


Run time limit 


Run time limit + 30 
sec 


Function 

close LOX & GH 2 purge valves 
Turn on ignitor 
Turn on start up GOX valve 
Turn on start up GH 2 valve 
Turn off ignitor 

Verify ignition- (Pch > 85 psia) 

If no ignition — 

Shut off GH 2 and GOX start up valves 
Secure System 
If ignition proved — 

Open LOX run valve 
Open GH2 run valve 
Verify main ignition (Pch > 400 psia) 
if no ignition — 

Open LOX and GH 2 purge valves 
Close LOX run valve 
Close GOX start up valve 
Close GH 2 start up valve 
Close GH 2 run valve 
Secure system 
If ignition proved — 

Open LOX and GH2 purge valves 
Continue run to preselected time limit 
Close LOX run valve 
Close GOX start up valve 
Close GH2 start up valve 
Close Gh2 run valve 

Close LOX and GH2 purge valves after 30 sec 
Secure system 
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RBCC CALORIMETER JEST 
NEW OPERATING PROCEDMRFS 
6 / 19/97 


LOX COLD FLOW TIMiNin- 


Time - Seconds 

0.000 

0.200 

1.150 

1.600 


Run time limit 

Run time limit + 30 
sec 


Function 

close LOX & GH 2 purge valves 
Turn on start up GOX valve 
Open LOX run valve 
Open LOX and GH2 purge valves 

Continue run to preselected time limit 
Close LOX run valve 
Close GOX start up valve 

Close LOX and GH2 purge valves after 30 sec. 
Secure system 


GH2 COLD FLOW TIMING 


Time - Seconds 

0.000 

0.250 

1.350 

1.600 


Run time limit 

Run time limit + 30 
sec 


Function 

close LOX & GH 2 purge valves 
Turn on start up GH 2 valve 
Open GH2 run valve 
Open LOX and GH 2 purge valves 

Continue run to preselected time limit 
Close GH2 start up valve 
Close Gh2 run valve 

Close LOX and GH2 purge valves after 30 sec. 
Secure system 
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CALORIMETER H? SYSTEM 


GH2 PURGE PRESSURE REGULATOR 


N2 PURGE SHUT OFF VALVE 


NITROGEN SUPPLY 

(FUEL) ^ 


GH2 SUPPLY PRESSURE REGULATOR 


GH2 SUPPLY o 



GH2 START UP 
PRESSURE REGULATOR 


H2 SHUT OFF VALVE 


H2 VENTURI 
.165" DIA 


(HP2) 

0 


(VENHJCj 


T/C 



I 


CALORIMETER TEST 
ITEM 


1/4" .035 WALL SS TUBE 


GH2 START UP VALVE 
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